Noise: A Flaw in Human Judgment
- Downloads：5254
- Type：Epub+TxT+PDF+Mobi
- Create Date：2021-05-09 21:30:55
- Update Date：2025-09-06
- Status：finish
- Author：Daniel Kahneman
- ISBN：B08KSC11KQ
- Environment：PC/Android/iPhone/iPad/Kindle
- Download
Reviews
Lloyd Fassett
，
4/30/21 Found it through an email I received from GoodReads because I like Thinking Fast and Slow
Theodore Kinni
，
“Wherever there is judgement， there is noise—and more of it than we think，” declare the authors。 They offer a comprehensive examination of the sources of noise and basic guidelines for recognizing and minimizing its negative effects。 （Forthcoming， May 2021）
Cindy
，
Would we all be better off if we got rid of human judges and used algorithms to make decisions？ Most of us would say “No，” but this book might make some of us change our minds。 There are many examples in the book， but let’s look at doctors。 There is some evidence that entering symptoms， medical history， etc into an algorithm would give more consistently good diagnoses than human doctors provide。 Why？ The book gives many reasons but a couple are that doctors are more likely to order follow up dia Would we all be better off if we got rid of human judges and used algorithms to make decisions？ Most of us would say “No，” but this book might make some of us change our minds。 There are many examples in the book， but let’s look at doctors。 There is some evidence that entering symptoms， medical history， etc into an algorithm would give more consistently good diagnoses than human doctors provide。 Why？ The book gives many reasons but a couple are that doctors are more likely to order follow up diagnostic tests in the morning than in the afternoon， and that some doctors make an initial diagnosis within a few seconds and then are very reluctant to change that diagnosis， regardless of subsequent evidence。 Algorithms don’t do either of these things， which are examples of “noise。”This is one small facet of this eye-opening book。 I would definitely recommend it。 My one complaint is that the last half of the book was very heavy on business examples。 “thinking Fast and Slow” seemed more generally social science-y and I did enjoy it more。 。。。more
David Wineberg
，
The sheer variety of ways judgment can be clouded is mind-boggling。 The more closely we examine judgments， the more noise turns up as a factor。 In Noise， an A-list team of celebrity psych stars， Daniel Kahneman， Olivier Sibony and Cass Sunstein pull together their confrères and evidence from the usual innumerable studies to delineate how bad it really is。Noise， at least in psychology， is “unwanted variability”。 In practical terms， that means even the most focused person might be swayed by unnoti The sheer variety of ways judgment can be clouded is mind-boggling。 The more closely we examine judgments， the more noise turns up as a factor。 In Noise， an A-list team of celebrity psych stars， Daniel Kahneman， Olivier Sibony and Cass Sunstein pull together their confrères and evidence from the usual innumerable studies to delineate how bad it really is。Noise， at least in psychology， is “unwanted variability”。 In practical terms， that means even the most focused person might be swayed by unnoticed noise。 Noise can be the home team losing the night before， lunch coming up in half an hour， miserable weather， a toothache – pretty much anything that has nothing to do with the issue at hand。 This is all in addition to personal prejudices and the framework of bureaucratic rules that are always in play， restricting the range of possible decisions， and misdirecting them where they should not be going。 All kinds of studies show that trial judges are inconsistent when not totally wrong。 The authors say two judges viewing the same evidence in the same case will come to two completely different decisions。 So will the same judge given the same case on two different occasions。 Sentencing is all over the place， which has led to enforced sentencing guidelines that often make things worse。 It has also led to judge-shopping， as the decision patterns of judges builds up over the years。 This is not based on evidence or argument， but in which way the judge’s decisions can be erroneous。 Think political parties， religion， and stubborn pig-headedness。The same goes for mere mortals， like supervisors。 They all believe they do a creditable job， but the stats show the direct opposite。 Even simple linear models do a far better job in every case。 Not just sometimes – every time， according to Noise。 Even randomly generated models do a far more accurate job of judging people correctly than people do。 Artificial intelligence algorithms can also add a little more accuracy， though surprisingly， not significantly so。 But people on their own perform miserably。Still， no one， but no one， would trust a simple model to make a decision on their future; they feel better having personally tried with another human， regardless of the facts。 It immediately reminded me of Lake Wobegon， where all the kids are above average。 Doesn’t work like that。 In the authors’ words， “Models of reality， of a judge or randomly generated models all perform better than nuanced， intuitive， insightful and experienced humans。” To which I would add: anyone who claims they can accurately size up a person on meeting them， can’t。Errors occur far more frequently than people realize， because everyone trusts their own judgment foremost， and far too often， the judgment of others （their lawyers， doctors and managers， for example）。 The worst example of this occurs in job interviews and performance appraisals。 Everyone knows the single worst way to make a hire is through a personal， unstructured interview。 Yet managers still insist on interviews， and so do candidates， thinking they can master the battle and win the job if they can simply deal with someone in person。 Both are totally wrong， yet nonetheless， they both persist。 Job interviews have become a nightmare for candidates， going back multiple times for essentially no good reason， as the more people interview them， the more inaccurate their ultimate decision will be。As for quarterly， semi-annual and annual performance appraisals， those who have to work with the results know they are usually totally worthless。 Managers burdened with multiple reports grind them out against a deadline， having little or nothing to do with an individual’s performance。 Most everyone is “satisfactory”， especially when managers are required to rate them on a scale。 No decisions can validly be taken from these exercises in frustration， but they are taken anyway。 And while essentially no one in any organization likes or ever looks forward to the whole process， the noise persists， clouding futures。Scales themselves are useless， as the authors show in examples such as for astronauts。 A bell-curve distribution would show one or two excellent performers， one or two total failures， and most in the middle。 But there are no total failures among astronauts。 The yearslong training requires and ensures it。 So grading on a scale against a bell-curve can be just more noise。For the open-minded， Noise provides details， tips and tricks to leverage。 For example， deliberation， the vaunted value of teams， actually increases the noise around a decision。 The mere fact that team members discuss their reasoning before they make a decision increases the noise for everyone participating。 The key to making teams work， ironically， is for everyone to do their own research in isolation， and once they have all come to a decision， they can then compare with others on the team。 They call this independent work “decision hygiene”。 It cuts down noise in general， but no one can know what specifically， or by how much。 The authors liken it to handwashing- no one knows what germs were there to kill。 All they know is that handwashing kills germs， and that you can never get rid of all of them。 The authors show that noise occurs in almost any shape or form。 The quality of the paper used for a business plan， and the font it is presented in， can tip the success or failure of a proposal in the hands of potential investors。Another interesting noise source is called whitecoat syndrome。 This is noise some people generate going to see a doctor， nurse or lab technician。 Their blood pressure rises in anticipation， sometimes causing an erroneous diagnosis。Things like prejudice are not so much noise as bias。 When assessing decisions that go wrong， noise is the standard deviation of errors， while bias is the mean itself。 The book is a thorough attempt to make a science of noise and errors in judgment。Bias is a likely driver of noise。 But the book is all about separating the two。 It shows that biases， such as “planning fallacy， loss aversion， overconfidence， the endowment effect， status quo bias， excessive discounting of the future， and various biases against various categories of people” are all factors in erroneous decisions。 But despite all this， sheer noise outweighs bias heavily。They use Gaussian mean squared errors to demonstrate the effect of both bias and noise， with noise the clear winner， and dramatically so。 Squaring the errors makes them visually arresting， But they still need to be stopped - somehow。It transpires that errors do not cancel each other out， either。 Instead， they add up， taking decisionmakers farther away from the right decision。 And with the book piling on a seemingly infinite selection of noise factors and sources， it’s a wonder Man has made it even this far。Speaking of erroneous judgments， it is difficult to decide what kind of book Noise is。 It is steeped in psychology， but it is not a groundbreaking new discipline。 People and firms have been actively trying to filter out noise since forever （the better ones， anyway）。 Nor is it a psych textbook， really， though there are exercises the reader can use right while poring over it。 I think it is closer to a handbook of what to be aware of: forewarned is forearmed sort of thing。 Though clearly， mere knowledge of the situation is far from enough to counteract it。 The book includes how-tos like implementing an audit to identify and isolate noise， so the book definitely has practical applications。 Handbook it is， then。This noise thing is ego-deflating for all humans， who run their lives continually making decisions， not only on facts， but predictive judgments as well （Predictions provide an “illusion of validity”）。 That we are not equipped to pull this off successfully – at all – should cause a total rethink of where we go from here。 Noise is pernicious。 Trusting models looms heavily over us all。David Wineberg 。。。more
Erdal Aral
，
Excellent ， good recipes for not making wrong judgements。
Irshad
，
Seems perfect
Angie Boyter
，
Noise is bad no matter where in life we find it。 In their new book Daniel Kahneman， Olivier Sibony， and Cass Sunstein say there is too much of it in our judgments and explain how noise arises and what might be done about it。 “Judgment” is not “thinking”。The book defines “judgment” as “a form of measurement in which the instrument is a human mind。” Judgments may be less than optimal due to bias， which is systematic deviation from optimal， e。g。the group’s predictions are ALWAYS overly optimistic， Noise is bad no matter where in life we find it。 In their new book Daniel Kahneman， Olivier Sibony， and Cass Sunstein say there is too much of it in our judgments and explain how noise arises and what might be done about it。 “Judgment” is not “thinking”。The book defines “judgment” as “a form of measurement in which the instrument is a human mind。” Judgments may be less than optimal due to bias， which is systematic deviation from optimal， e。g。the group’s predictions are ALWAYS overly optimistic， or noise， which is a more random scatter。 The main topic of the book is “system noise”， which is “unwanted variability in judgments that should ideally be identical。” （I should get the same jail sentence no matter which judge hears my case。） System noise has two main components。 There is level noise （ A particular judge is lenient in granting bail。） and pattern noise。 Pattern noise also has two components: stable pattern noise， （Such as a tendency to give women lighter jail terms）， and occasion noise （ I just had a run-in with my boss）。。 The book discusses each of these types of noise and their psychological aspects， drawing on earlier work such as Sunstein’s “nudge” and Kahneman’s “System 1 and 2” thinking。 Readers who are not somewhat familiar with this work might find a quick google search helpful。 There is also some discussion of the statistics involved that I suspect will be cryptic to most people who do not already know a bit about statistics。 If so， you can certainly ignore the math。So once you know sources of noise in judgment， what do you do about it？ The authors describe some remedies， such as a “noise audit” or a “decision observer” to help remove bias from judgments in groups or a judicious use of rules or standards。There is a lot of good and thought-provoking insight in Noise， principles that everyone will recognize once they are pointed out but that interfere with good judgment unless we identify and address them。 The authors show how to do this with extensive descriptions of judgments in a number of fields， like selecting new hires， setting bail or sentences in criminal cases， and medical decisions。 As a result， this is rather a long book， and these descriptions can be skimmed if you are very focused on task， but they are interesting。 The applications described in this book are primarily decisions made by multiple people， whether they be judges setting bail or group recommendations on whether a company should acquire another company。 It does not focus much on decisions people might make in their personal lives， but the principles certainly seem applicable there as well。 I am sure the authors would recommend that I not review this book just before lunch and after an argument with my spouse！Insightful analysis of why we make bad judgments 。。。more
James Hammer
，